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IDA  Estimating  Price  Indices 


■  Price  indices  are  normally  estimated  by  comparing 
the  observed  prices  of  identical  goods  in  successive 
years 

■  This  is  easy  when  goods  don’t  change  much  from 
year  to  year 

■  Milk,  gasoline,  haircuts, ... 

■  When  the  characteristics  of  products  for  sale  change 
too  quickly,  we  need  to  correct  for  quality  changes  to 
estimate  real  price  growth 

■  Computers,  cell  phones,  military  aircraft... 
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IDA  Quality-Adjusted  Price  Indices 


■  There  are  two  main  approaches  to  quality- 
adjusted  price  indices 

■  Estimate  the  amount  of  price  change  due  to  new 
features  for  each  new  product  on  a  case-by-case 
basis;  assign  any  additional  change  to  real  price 
growth 

■  Construct  a  hedonic  model  of  price  change  that 
predicts  price  as  a  stable  function  of  quality 
attributes;  use  annual  fixed  effects  to  capture 
cumulative  real  price  growth 
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IDA  Previous  Work 
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price  growth  for  decades 

■  IDA  identified  a  potential  systematic  bias  in  those 

estimates,  and  estimated  much  higher  price  growth  for  a 
fixed  quality  level 


■  The  IDA  methodology  made  extensive  use  of  lot-by-lot 
aircraft  empty  weight  as  a  proxy  for  unobserved  quality 
improvements 
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IDA  Ground  Vehicle  Prices 

■  The  goal  of  this  work  was  to  extend  the  IDA 
methodology  to  estimate  a  hedonic  price  index  (or 
indices)  for  military  ground  vehicles 

■  Available  data  had  uneven  reliability  and  varying 
definitions  of  “price” 

■  Selected  Acquisition  Report  -  total  cost/quantity 

■  President’s  Budget  -  vehicle-only  cost/quantity 

■  MRAP  contract  data  from  CAPE-CA 

■  Contract  announcements  from  infoBASE 

■  Jane’s,  FAS,  contractor  websites,  etc. 
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IDA  Hedonic  Specification 


■  The  best  hedonic  model 
specification  used  8 
quality  variables 

■  3  continuous 

■  5  binary 

■  Lot  size 

■  Learning  by  doing 

■  Only  relevant  for  2  out  of 
40+  vehicle  types 

■  Log-log  specification 
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■  Power  density  (hp  /ton) 

■  Top  speed 

■  Ground  pressure  (psi) 

■  Tracked? 

■  Combat? 

■  Turret? 

■  Armored? 

■  Derivative  design? 
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IDA  Predictors  Highly  Significant. . . 


Standard 


Parameter 

Estimate 

Error 

(Intercept)... 

9.35 

1.35 

*  *  * 

Residual  SE... 

0.198 

log(Top  Speed)... 

-2.28 

0.26 

*  *  * 

Degrees  of  freedom... 

139 

log( Ground  Pressure)... 

-0.94 

0.13 

*  *  * 

Adjusted  R2. . . 

0.975 

log(Gross  Vehicle  Weight)... 

0.93 

0.06 

*  *  * 

Armored?... 

0.93 

0.10 

*  *  * 

All  p-values  <  10"5 

Tracked?... 

-1.66 

0.26 

*  *  * 

Combat?... 

0.78 

0.06 

*  *  * 

Turret?... 

0.49 

0.09 

*  *  * 

Derivative?... 

-0.28 

0.07 

*  *  * 

log(Lot  Size)... 

-0.07 

0.01 

*  *  * 

M9_ACE  learning  slope. . . 

-0.17 

0.04 

*  *  * 

M992_FAAS V  learning  slope. . . 

-0.10 

0.03 

*  *  * 
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Real  Price  Index  (1.0  =  2010) 


IDA  Annual  Fixed  Effect  Estimates  Were  Not  Robust 
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IDA  Bootstrapping  Reduced  the  Fixed  Effect  SE 
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IDA  But  there  were  some  issues 

■  “Negative  learning” 

■  Most  systems  show  lot-by-lot  unit  price  growth 

■  Naive  regression  estimates  15%  overall  annual  average 

■  Suggests  unobserved  quality  improvements 

■  In  the  aircraft  work,  year-over-year  weight  growth  was 
highly  significant  -  proxy  for  quality  improvements 

■  Price  index  estimation  sensitivity 

■  The  estimated  annual  fixed  effects  are  not  robust  with 
regard  to  either  subsample  or  model  selection 

■  Many  models  with  similar  fit,  very  different  annual  fixed  effects 

■  It  is  possible  to  get  a  very  good  fit  without  any  annual  fixed 
effect  terms  -  what  does  this  indicate? 
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IDA  Alternative  Formulation:  The  "Pure  Price"  Model 


■  Assume  that  each  vehicle  model  is  characterized  by 

■  An  initial  unit  price 

■  An  initial  quality  level 

■  A  production  rate  price  dependency 

■  An  unobserved  implicit  quality  growth  rate 

■  Version  1  -  constant  by  vehicle  family 

■  Version  2  -  constant  by  vehicle  type 

■  Estimate  unit  price  as  a  function  of  these 
parameters  plus  annual  fixed  effects 
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IDA  Results  in  More  Stable  and  Credible  Estimates 
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~  5.1%  average  annual  price  growth 


Year 

Index  (by  vehicle) 

Index  (by  family) 

1996 

48.6% 

45.7% 

1997 

50.3% 

49.1% 

1998 

58.9% 

55.5% 

1999 

60.2% 

57.4% 

2000 

63.4% 

62.2% 

2001 

76.4% 

72.6% 

2002 

80.8% 

77.0% 

2003 

83.2% 

80.0% 

2004 

84.0% 

81.2% 

2005 

88.0% 

85.6% 

2006 

85.0% 

83.1% 

2007 

98.7% 

95.8% 

2008 

96.3% 

94.4% 

2009 

91.3% 

93.3% 

2010 

93.5% 

98.3% 

2011 

100.0% 

100.0% 
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IDA  Summary 


■  Military  vehicle  characteristics  change  too  quickly  for 
ordinary  price  index  calculations  to  apply 

■  Hedonic  models  make  assumptions  that  probably 
aren’t  true  for  military  vehicles 

■  That  we  know  the  relevant  quality  attributes,  and  have 
good  lot-by-lot  data  for  them 

■  That  the  value  to  the  buyer  of  a  given  quality  attribute  is 
constant  over  time 

■  The  pure  price  model  gives  stable  and  credible 
estimates,  but  requires  one  iffy  assumption 

■  That  unobservable  quality  growth  is  roughly  constant  by 
vehicle  type/family 
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IDA 
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Backup 


IDA  Problem  Background 


■  The  Weapon  Systems  Acquisition  Reform  Act 
of  2009  (WSARA)  tasks  OSD(CAPE)  with 
“...assessing  and  updating  the  cost  indexes 
that  the  Department  of  Defense  employs  to 
ensure  the  use  of  realistic  cost  estimates.” 

■  OSD(CAPE)  asked  IDA/CARD  to  assist  in 
assessing  the  accuracy  of  existing  price 
indices  for  various  types  of  system 
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IDA  What  are  price  indices  used  for? 


■  Program  offices  use  price  indices  to  estimate  the  future 
budgetary  requirements  of  acquisition  programs  in  then-year 
dollars 

■  Oversight  organizations  use  price  indices  to  distinguish 
sector-specific  real  price  growth  from  general  inflation 

■  OMB  uses  price  indices  to  estimate  the  relative  burden  of 
defense  procurement  (or  subsets  thereof)  on  the  economy 

■  DoD  leadership  would  like  to  be  able  to  distinguish  changes 
in  the  price  of  military  capability  from  changes  in  the  amount 
of  capability  demanded 
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IDA  Data  Set 


■  Ml  Abrams  tank  (2  blocks) 

■  M2  Bradley  Fighting  Vehicle  (3  blocks) 

■  M9  Armored  Combat  Earthmover 

■  M998  HMMWV  (2  blocks) 

■  M992  Field  Artillery  Ammunition  and  Support 
Vehicle  (FAASV)  (2  blocks) 

■  M4  Command  and  Control  Vehicle  (C2V) 

■  Stryker  family  (8  variants) 

■  M992A2  FAASV 

■  Armored  Security  Vehicle  (ASV) 

■  Family  of  Fleavy  Tactical  Vehicles  (10  variants,  ~2 
blocks  each) 

■  HMMWV  (3  variants) 


■  MRAP  variants 

■  Buffalo 

■  Cougar  FI 

■  Cougar  FIE 

■  MaxxPro 

■  MaxxPro  Dash 

■  MaxxPro  Dash  DXM 

■  MATV 

■  MATV-UIK 
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IDA 
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Vehicle  buys  by  year 
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fit$fitted 


IDA  Predicted  vs.  Actual  Log  (Lot  Price) 
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IDA  Negative  Learning 
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Vehicle 


■ASV 

-Cougar  H 
-Cougar  HE 
-Ml  Abrams 
-M1025A2  HMMWV 
-M1097  Heavy  HMMWV 
-M1113  HMMWV  ECV 
-M1114  UAH 
-M1A1  Abrams 
-M2A0  Bradley 
-M2A1  Bradley 
-M2A2  Bradley 
-M9ACE 
-M998  HMMWV 
-M-ATV 
•M-ATV  UIK 
MaxxPro 
-StrykerATGM 
-StrykerATGM-VV 
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IDA  High  Standard  Error  for  Annual  Fixed  Effects 
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IDA  Model  Specification 
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HUj  )  =  A+Z  PJjk  +  £  fir*1  ft  U^N, )  +  Piv+\  ln(Sy.)  +  X«^ 


Jt=l 
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U:  =  unit  price  of  purchase j 

V  =  number  of  vehicle  types 

Qj  =  lot  size  of  purchase  j 

Nj  =  lot  number  of  purchase  j 

Lk  =  1{  purchase  j  is  of  vehicle  type  k } 

T=  number  of  years  covered  by  purchases 
Yjt  =  1{  purchase  j  was  in  year  t } 

Exp(a,)  =  price  index  for  year  t 
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IDA  Way  Forward 


■  Compile  more  data 

■  Medium  tactical  vehicles 

■  Fill  the  1994-95  gap;  extend  beyond  2011 

■  Bootstrap  to  reduce  the  variance  of  the  pure 
price  model  estimates  as  well 

■  Explore  models  with  no  lot  size  effect 

■  Should  an  ideal  price  index  describe  price 
growth  for  fixed  quality  and  quantity,  or  just 
quality? 
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